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Abstract — The problem of finding an bound of reachable sets for neutral markovian jump systems with 
bounded peak disturbances is studied in this paper. Up to now, the result related to the bound of reachable 
sets was rarely proposed for neutral markovian jump systems. Based on the modified Lyapunov-Krasovskii 
type functional and linear matrix inequality technology, we obtain some delay-dependent results expressed 
in the form of matrix inequalities containing only one noil-convex scalar. Numerical examples are given to 
illustrate our theoretical results. 
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I. INTRODUCTION 

In practice and engineering applications, many dynamical 
systems may cause abrupt variations in their structure, due 
to changes in the interconnections of subsystems, sudden 
environment changes, and so on. Markovian jump systems, 
which are modeled by a set of subsystems with transitions 
among the models determined by a Markov chain taking 
values in a finite set, have been extensively studied, see [1- 
5] and the references therein. On other hand, neutral 
system that the time derivative of state depends not only on 
the delayed state but also on its time derivative exists in 
many dynamic systems. Since many complex systems can 
be modeled preferably as neutral systems, a great deal of 
attention has been drawn to the study of neutral systems for 
the last two decades, such as [6-8], and the references 
therein. Recently, many researchers have paid a lot of 
attentions on the problem of the dynamic properties for 
neutral Markov systems [9-12], 

The reachable set estimation of dynamic systems is 
defined as the bounded set containing all reachable state 
trajectories starting from the origin under the constraint of 
admissible bounded inputs. Recently, the reachable set 
estimation problem has received growing attention, which 
due to its importance in solving the problem of state 
estimation and parameter estimation. Then, an increasing 
number of researchers have devoted their efforts to the 
problem of reachable set estimation [14-23]. In [16], a 


delay-dependent condition for an ellipsoid bound, which 
contained five non-convex scalar parameters to be treated 
as tuning parameters for finding the smallest possible 
ellipsoid, was derived based on the Razumikhin approach 
and the S-procedure Kim 1181 proposed an improved 
ellipsoidal bound of the reachable set of reachable states 
based on constructing a modified the Lyapunov functional 
and Linear Matrix Inequality Method 1131 . This limitation 
may restrict the scope of application for this method. By 
using a maximal Lyapunov-Krasovskii functional which 
was constructed by taking pointwise maximum over a 
family of Lyapunov functionals, some criteria bounding 
the reachable set bounding for delayed systems subject to 
both polytopic uncertainties and bounded peak inputs was 
derived in [20]. In [21], an ellipsoidal bound of reachable 
sets for neutral systems with bounded peak disturbances 
was obtained in the form of matrix inequalities containing 
only one nonconvex scalar based on the modified 
augmented Lyapunov-Krasovskii type functional. Lin, He, 
Wu and Liu [201 concerned with the reachable set estimation 
for Markovian jump neural networks with time-varying 
delay and bounded peak inputs. By using the Wirtinger- 
based integral inequality and the extended reciprocally 
convex matrix inequality, an ellipsoidal description of the 
reachable set for the considered neural networks is derived. 
But the result about the bound of reachable set bounding 
was rarely proposed for neutral markov systems. 
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However, the bound of reachable sets for neutral 
markovian jump systems with bounded peak disturbances 
has not been investigated, which motivates this paper. In 
this paper, we consider the problem of finding an bound of 
reachable sets for neutral markovian jump systems with 
bounded peak disturbances. Based on the modified 
Lyapunov-Krasovskii type functional, some delay- 
dependent results are derived in the form of matrix 
inequalities containing only one non-convex scalar. 
Furthermore, a modified matix inequality is used, to 
remove the limitation on the variation rate of the delay and 
obtain a "smaller" bound of reachable sets. Numerical 
examples illustrate the effectiveness of the obtained results. 


n, PROBLEM STATEMENT 

Consider the following neutral markovian jump systems 
with disturbances : 

x(r) - C (r rr) x(t - r) = A ( ,. r ,) x (0 

+ B (tr) X(t-h(t)+D { , r) W(t), ( 1 ) 
x(t o +0) = 0, V<9e [-/?*,0], 

where x(t) e 91" is the state vector, r > 0 is a constant 
neutral delay, the discrete delay h{t) is a time-varying 
function that satisfies 

0 <h(t)<h M ,h(t)< h d < 1, w T ( t)w(t ) < w 2 m , (2) 



? 


An 

An 


A 


N 


? ••• X 


NN 


(4) 


where ? represents the unknown transition rate. For 
notational clarity, V(£p , the set U' denotes 
U‘ =U , k {jU‘ uk with 


U‘ k :={j \A. tj is known for jep}, 

U' uk -={j 1 Aj is unknown for jep}, 

moreover, if U' k ^ (/> , it is further described as 

U' k ={k[,k’ 2 ,-■ ■ ,k' m } , where m is a non-negation integer 

with 1 <m<N and k' eZ + , 1 <k\<N , / = 1,2, 

represent the known element of the /th row and jth column 
in the state transition probability matrix A . 

For the sake of brevity, x(t) is used to represent the 
solution of the system under initial conditions x(t,t 0 ,x 0 ), 
and {x(t),t} satisfies the initial condition ( x 0 ,r 0 ). and its 
weak infinitesimal generator, acting on function V , is 
defined in [37]. 

LV(x,,t,f) = lim ^[E(V(x, +A ,t + A,r, +A ) \ (x ^ =i) 
-V(x t ,t,r t )]. 


p* = max(r,h M ), {r f ,f>0} is Markovian process taking 
values on the probability space in a finite state 
p = {1,2,- ■ -, N] with generator A = {2 ij }(yep) and A 
is described as follows 


This paper aims to find a reachable set for neutral 
markovian jump systems (1) based on the Lyapunov- 
Krasovskii functional approach. We denote the set of 
reachable states with wit) that satisfies (2) by 


p (r , + a = j 1 r, = 0 = 


UtjA + o(A),i* j, 
jl + 2..A + o(A),/ = j, 


(3) 


where A > 0 , lim 

A-»0 


o(A) 

A 


0, Ay > 0 (i ^ j) is the transition 

N 


probability from i to j at timer —»f + A, =- . 


A Uj]) . B l!JU ,C (IJi) and D v } are known constant matrices 
of the Markov process. 


Since the state transition probability of the Markovian 
jump process is considered in this paper is partially known, 
the transition probability matrix of Markovian jumping 
process A is defined as 


(R v = {x(t) e 91" I x(t),w(t) satisfy (\)and(2)}. (7) 
We will bound 91 v by an ellipsoid of the form 

3(P,1) = {x{t) e 91" I x(t) T Px(t) < l,P > 0}. (8) 

For simplicity, there are the following representations: 

Aj — A (f ,r,=i), B t = B (uri=i j, Cj =C kUrf=i y 
D i ~ D U,r,=i)’ P = P(l.r,=i)' 

In this paper, the following Lemma and Assumption are 
needed. 

Lemma 1 [13] . Let VTa'(O)) = 0 and w T (t)w(t) < w \ n , if 
V(x, )) + aV(x, ) - J3w r ( t)w(t ) < 0,« > 0, /? > 0, 


then we have V (x,)) < — w m for all Vt > 0. 
a 
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Lemma 2 [131 Suppose h> 0 and x(t) e S .R" , for any 
positive definite matrix W the following inequality holds 


h f x (s)Wx(s)ds < 

Jt-h 

x T (t) 

x T (t 

~h)\ 


'-W 

W ' 

x(t) 


_ w 

-W 

x(t - h ) 


(9) 


Lemma 3 [181 . For any positive-definite matrix cD e '.R", 
scalar ;/ > 0 , vector function w : [0,;/| —» S .R" such that the 
integrations concerned are well defined, then 

(j^ x(s)ds)' 0(J x(s)ds) < £7 r (sKt ) x(.s)4.s. 


Then, the reachable sets of the system (1) having the 
constraints (2) is bounded by a boundary f| 3(/ > li ,l) , 

iep 

which 3(P ll ,l)(i e p) is defined in (8). 

Proof: We choose the following Lyapunov-Krasovskii 
functional candidate as follows: 

V(x„t,r,) = f j V i (x l ,t,r l ), (13) 

i=i 

where 

Vj (x,, t, r t ) = x T (t)P Wi x(t) = \x T (t) x T (t-h )J 


7 

o' 


0 " 

x(t) 

O 

o 1 

fir. 

73 

1_ 

r ^ _ 

1 


III. MAIN RESULT 

Our aim is to find an ellipsoid set as small as possible to 
bound the reachable set defined in (3). In this section, 
based on Lyapunov method and linear matrix inequality 
techniques, following Theorems are derived. 

Theorem 1 Consider the markov neutral system (1) with 
constraints (2), if there exist symmetric matrices P v , P 3j , 
P u >0, W, >0(1 = 1,2, ■••,1V ), Q>0, R> 0, S>0 and 
a scalar a > 0 satisfying the following matrix inequalities 


V 2 (x,,t,r) = f e aKs n x' (s)Qx(s)ds, 

Jt-h(t) 

V 3 (x, ,t,r t ) =| e“ (M| i r (s)Rx(s)ds, 

VAx.,t,r)= f f e a{s ~ n x T (s)Sx(s)dsd 6, 

j-i, M J,+e 

where P 2j , P v P u > 0 , W { > 0 ( i = 1,2, • • •, N ), 

<2>0, R> 0 , S >0 and a scalar a > 0 are solutions of 
(10). 


d), = 



N , 






First, we show that U(x,) in (11) is 

a good 

L-K 

®,1 

I 

0,13 

P T C 

r 2i 

Pl,D, " 



functional candidate. For t — h M <s <t , we have 


* 

<^22 

PJ,B, 

P T C 

r 3i W 

p l D i 




0 < e~ ahM < < 1. 



* 

* 

0,33 

0 

0 

<0, 

(10) 





* 

* 

* 

-e ar R 

0 


. Furthermore, for t — h M <s <t , we have 



* 

* 

* 

* 

-SLi 




4 



- 








Y J V,(x,,t,r,)>0. 

i—2 




Pyr 

w, < 0 , 

jeul. 

j * i, 


(11) 

Therefore, we get 




Pyj- 

w, > 0 , 


j = i. 


(12) 

, 

V (x,, t, r ,) = Y, v i (L ,t,r,)>x T ( t)P lr> x(t), 

1=1 

(14) 









V(0)=O, when x{0) = 0 ,0 e [t - 

P*A], 


lA 

+ AfP 2 

+ Q~h 

^S + aP. + ZWj 

Then, for 

given r t =iep, P = P u , P 2 = 

P P 

r 2i ’ r 3r t 

= P 3, 


where 


-W t ), 

®,12 = P U ~ P Ii + A f 3 i’ 

®,13 =PlB + h M e-*"Pu, 

®i22 = s +R-P 3 - P 3i , 

0,33 = -(1 - h d )e~ ah ^ Q - h M e S . 




and the weak infinitesimal operator L of the stochastic 
process x(t) along the evolution of V k (x,,t,r t ) 
(k =1,2are given as 


LVfx,,t, i t ) = 2[x r (t) x T (t - h ) 


Pu, Pi, 

. o Pi 


x(t) 

0 


N 


+ x r (t)['Y J XjP ij ]x(t) 

jeU'k 
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r n 


= 2[x r (f) x T it - li) 

Pu Pi 

LV, ix ,, t,i) = hik T (0Sx(0 - h.. f e s(H) i r is)Sxis)ds 

Jt-h M 


1° P l\ 

r , » -\T 


< hi, x (t)Sx(t) - h M e 


-ah M 


xit) 
x(t - h(t)) 


1 

Co 

Co 

1 

1_ 

1 

1_ 

s -s 

r ^~ 


-aV 4 . 


x(t) 

. f A, xit) - xit) + Cx(t - r)'| 

+ If xit - hit)) + Dw(t) y 

+ x T (t)[f J A i jP lj Mt) 

Wk 

= x T ( t) [Pi A,. + Af P 2i ]x(t) + 2x t (t) [P u - Pi 
+ Af P 3i ]xft) + 2x t it)PlB,xit - h(t )) 

+ 2x t ( t)PlCjX(t - t) + 2x t (t)PlD-w(t) 

- k T (t) [Pi + P 3i ]B,x(t) + 2x t it) Pi If 

■ xit - hit)) + 2x r (t)PlC i x(t - t) 

+ 2x t it) Pi D t wit) + x T it^Jl^jPijMt). 

7=1 

Taking into account the situation that the information of 
transition probabilities is not accessible completely, due to 

N 

y /L =0 ( / e p ), the following equation hold for 

7=1 

arbitrary appropriate matrices W j = Wf are satisfied 

-x T it)f j A^W i x(t) = 0. (15) 

7=1 

It is trivial to obtain the following equality: 

LV { ix, ,t,i) = x T it)[Pi A,. + A, 7 P 2i ]xit) + 2x t it)[P h - Pi 
+ AjP 3j ]i'(f) + 2x t it)Pl i B j xit - hit)) 

+ 2x T it)PiC,xit - r) + 2 x T it)PiD f wit) 

- k T it)[Pl + P 3i ]B,m + 2x T it)PlB, 

■ xit - hit)) + 2 x t i^PlCjXit - t) + 2x t it)Pl 

■ D,wit) + x T (f)[yy iP {j -W t )]x(f) 

MU‘ k 

+ x T (t)[jlA ij iP lj -W i )]x(t). 

i^U'uk 

LV 2 ix ,, t, i) = x T (t)Qx(t) - (1 - hit))e- ah(,) x T it - hit))Q 

■ xjt - hit)) - a f e a{s ^x T {s)Qx{s)ds 

Jt-h(t) 

< x T it)Qxit) - (1 - h d )e ahu x T it - h(t))Q 

■ xit - hit)) - aV 2 , 

LV 3 ix,,t,i) = x T it)Rxit) - e~ ar x T it - t)R 

■ xit - t) - a[ e^^x 7 is)Rx(s)ds 

Jt-T 

= x T it)Rxit) - e~ aT x T it - r)Rxit - z) - aV 3 , 


We further have 

LVix ,, t, i) + aVix, , t , i) - w T it)wit) < x T it)[Pl A, 

+ Af P 2 , +Q-h M e~ ahu S + aP u + £ A, (/>, 

jeU‘ k 

- W, )]x(t) + 2x t it) [P u - Pi + Af P 3i ]xit) 

+ 2x t it)[Pl,B, + h M e~ a,,u S ] x(f - hit)) 

+ 2x t it)PlC,xit -t) + 2x t it)Pl D^vit) 

+ x T it)[dr M S + R-Pl -P 3i ]B,xit) + 2x T (t)Pl 
■ B,xit - hit)) + 2x t it)PlC,xit - t) 

+ 2x t it)PlD,wit) -x T it- hit))[ a - h d )e- ahM Q 
+ h M e~ al ' M 5]x(t - hit)) -e~ ar x T it - r)Rx(t - z) 

~^w T it)wit) + x T it)[jl 4 (P t J - W, )]xit) 

K 7=1 

= Z T m i l(t) + +x T (t)[f j A IJ iP lj -w,))xit). 

7=1 

where O is the same as defined in the Theorem 1 and 
it) = \_x T it) x T it) x T it-hit)) x r it-z) W ‘it)\ 
Thus, from matrix inequalities (10)-(12), we get 

LVix, ) + aVix,)--^w T it)w{t) <0, (16) 

which means, by Lemma 1, that V(x,,t,r t ) < 1, and this 
results in V l (x,,t,i) = x T (t)P u T (t) < 1 for iep , since 
V 2 ix ,, t,i) + V 3 ix ,, t,i) + V 4 ix ,, f, i) > 0 from (14). 

So the reachable set of the system (1) is bounded by 
ellipsoid 3(P l; ,l)(i ep) defined in (8), which implies that 
the reachable sets of the system (1) having the constraints 
(2) is bounded by a boundary fl 3(P 1; ,1) . This completes 

iep 

the proof. 

Remark 1. It should be noted that the more the 
unknown elements there are in (4), the lower the maximum 
of time delay will be in Theorem 1. Actually, if all 
transition probabilities are unknown, the corresponding 
system can be viewed as a switched neutral markovian 
jump system under arbitrary switching. Thus, the 
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7 

o" 

I _ 

i 

O 

0 

o 1 

i 

Jo 

1 _ 


V, (x t , t , r t ) = [a T (t ) x T (t - h) 

■ f e a(s ~ ,) x T (s)Qx(s)ds 

Jt-h(t) 

-f e a ^~ l) x T (s)Rx(s) + f f e a(s ~ n x T {s)Sx(s)dsdd. 

Jt-T *-hM Jt+0 


x(t) 
x(t - h) 


Following a similar line as in proof of Theorem 1, we can 
obtain the following Theorem 3. 


Following a similar line as in proof of Theorem 1, we 
can obtain the following Theorem. 

Theorem 2. Consider the markov neutral system (1) 
with all elements known in transition rate matrix (4), if 
there exist symmetric matrices P 2i , P 3j , P u > 0 , 

W t >0 ( i = l,2, — ,N ), Q >0 , R >0 , S>0 and a 
scalar a > 0 satisfying the following matrix inequalities for 


1,2,- •• 

,N, 

^ ill 


®,13 

P T C 

r 2 i 

P T D 

r 2i LJ i 


* 

^122 

PlB, 

P T C 

r 3i 

p T d 

r 3i 

(P, = 

* 

* 

®,33 

0 

0 

* 

* 

* 

~e ar R 

0 


* 

* 

* 

* 







w 

m 


where 

=P£A +AfP 2i +Q-h M e-^S+aP li + 

jeV' k 

®,12 =Pu-Pl+^P v , 


Theorem 3. Consider the markov neutral system (1) 
with all elements unknown in transition rate matrix (4), if 
there exist symmetric matrices P 2j , P 3j , P Vl > 0 , 
W l > 0 ( i = 1,2, - - -, N ), Q> 0 , R> 0 , S> 0 and a 
scalar a > 0 satisfying the following matrix inequalities for 


1,2,- •• 

,N, 

®,-n 

4\l2 

4\l3 

P T C 

r 2i '-'i 

P T D 

r 2i lJ < 


* 


PlB, 

P T C 

r 3i '-'i 

P T D 

r 3i LJ i 

(P, = 

* 

* 

®,33 

0 

0 

* 

* 

* 

-e ar R 

0 


* 

* 

* 

* 

--Z-I 






w 

m 


where 


0,1 =p£A i + A]P 2j +Q-h M e rJ ‘ M S + aP u , 
=Pu~Pl i +A?P 3i , 

®, 13 =PZB + h M e-*"P 3i , 

® i22 = S + R — P 3 —P 3i , 


0,3 = P 2 ,B + h M e ^’P 3l , 

®i22 = S + R— P 3 ~ P 3i , 

®,33 =-(l -h d )e-*"Q-h u e-«“S • 

Then, the reachable sets of the system (1) having the 
constraints (2) is bounded by a boundary fj 3(/’ 1 ,,l) , 

iep 

which 3(Pu,,l)(i e p) is defined in (8). 

For finding the bound of reachable sets for neutral 
Markovian jump systems with all transition probabilities 
are not known, which indicate that system (1) is a 
switched neutral delay systems. One can construct the 
following Lyapunov functional and obtain the Theorem 3. 


0,33 = -d - K )e~ rJhM Q - h M e-^ S . 

Then, the reachable sets of the system (1) having the 
constraints (2) is bounded by a boundary fl 3('P I ,,1) , 

iep 

which 3(/^ ,l)(7 g p) is defined in (8). 

Remark 2. The solution for (10-12), (17) or (18), if 
it exists, need not be unique. It is well-known ([13]) that 
the volume of ~s(P u ,\)(i ep) defined in (8) is proportional 

i 

to Vdet (P u ) , so the minimization of detlP,) 2 is the same 

as minimizing the volume of 3(P I; ,1). That is, maximize 

i 

det(P 1( ) 2 subject to SI < P u which can be equivalent to the 
following optimization problem: 
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minjmin det(P. ) 2 ) 

Sj jefp 1 

(a < 19) 

A p u ~Si>0,lsp, 

S ' '{(10-12), (17)or(18). 

Remark 3 The matrix inequalities in Theorem 1 and 
Theorem 2 contain only one non-convex scalar a (for 
given h M and h d , and these become LMI by fixing the 
scalar a . The feasibility check of a matrix inequality 
having only one non-convex scalar parameter is 
numerically tractable, and a local optimum value of a can 
be found by fminsearch.m. 


IY. EXAMPLE 

In this section, a numerical example demonstrates the 
effectiveness of the mentioned above. Consider the neutral 
markovian jump systems with three operation modes 
whose state matrices are listed as follow: 


x(t) - -t) = A {t r ) x(t) 

+ B 0.r,) X ( t - h ( { ) + D (t.r,) W ( 0 . ( 20 ) 

x(t 0 +9) = 0, V0e [-/>*,0], 


where 




-2 

-f 


-3 

0 " 


"-2 

0 

A = 




, A 2 = 



, a 3 = 





0 

-2 


0 

-2 


-1 

-1.5 



“-1 

0 


"-2 

0" 


“-2 

0 " 

A = 




, B 2 = 



, b 3 = 





-1 

-2 


-1 

-1 


0 

-2 



"-1 

0 " 


"-2 

0" 


"-2 

0 " 

Cj = 




, C 2 = 



, c 3 = 





-1 

-2 


-1 

-1 


0 

-2 



-0.15 


-0.14 


-0.2 

D l = 


, d 2 = 


, d 3 = 



0.!5 


0.35 


0.3 


The transition rate matrix A is considered as the 
following three cases. 


Case 1. The transition rate 

known, which is considered as 

matrix 


- 0.6 

0.2 

0.4 

A = 

0.6 

-1 

0.4 


0.3 

0.5 

-0.8 


is completely 


Case 3. The transition rate matrix A is completely 
unknown, which is considered as 


? ? ? 


A = ? ? ? 


? ? ? 



Fig. 1: Random jumping mode r(t) of neutral markov jump 
system (20) 


xT 



X 


Fig. 2: The time responses of state variable x(t) of neutral 
markov jump system (20) in case 1 

Firstly, by giving the transition probabilities A, a 
possible mode evolution of the neutral markov jump systm 
(21) is derived as shown in Fig. 1. Based on the mode 
evolution shown in Fig. 1, and choosing disturbances 
$w(t)$ as the random signal satisfying w r (t)w(t) < 1, all 
the reachable states of neutral markov jump systm (21) 
starting from the origin are given in Fig.2. 



Case 2. The transition rate matrix A is partly known, 
which is considered as 


- 0.6 


A = ? 


0.2 0.4 

-1 ? 


? ? ? 
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By using theorem 2 and solving the optimization 
problem (20) in case 1, we can obtain minimization of 
i 

det(Pj, ) 2 is 0.2119 when a = 0.1, and the corresponding 


feasible matrices are given as l \, = 


7.3166 3.5856 
3.5856 4.7999 


"9.0948 

2.6437" 

. f 3 = 

"6.8632 

2.6743" 

2.6437 

2.5838 

’ 15 

2.6743 

1.8016 


The 


reachable sets of the system (23) in case 1 is bounded by a 

3 

intersection of three ellipsoids: Q3(/j p 1) , which is 

i=l 


depicted in Fig. 3. 


Fig. 3: The hound of reachable sets for neutral markov 
jump system (20) in case 2 



By using theorem 1 and solving the optimization 
problem (20) in case 2, we can obtain the minimization of 
i 

det(Pj,) 2 is 0.4621 when a = 0.1 and the corresponding 


feasible matrices are given as P n 


6.6245 2.5552 
2.5552 1.6846 


"6.4226 

2.5544" 

. P n = 

"6.6851 

2.5788" 

2.5544 

1.6857 

2.5788 

1.6952 


The 


reachable sets of the system (23) in case 1 is bounded by a 

3 

intersection of three ellipsoids: Q3(7^,1) , which is 

/-i 


depicted in Fig.4. 


By using theorem 3 and solving the optimization 
problem (20) in case 3, we can obtain the maximize 
S = 0.65 when a = 0.1, and the corresponding feasible 


Fig. 4\ The bound of reachable sets for neutral markov 
jump system (20) in case 3 



matrices are given 


as 


Pi i = 


8.1386 4.3002 
4.3002 4.8168 



[9.0931 

2.6563] 


[6.6807 

2.6735] 

- T - T - 1 - T - 

P n = 

2.6563 

2.5718 

. P n = 

2.6735 

1.8013 


The 
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Fig. 5: Random jumping mode r(t) of neutral markov jump 
system (20). 


is 


reachable sets of the system (23) in case 1 is bounded by a 

3 

intersection of three ellipsoids: P|3(P lp l) , which i 

;=i 

depicted in Fig.5. 


V. CONCLUSION 

In This paper, the problem of robust stability for a class of 
uncertain neutral systems with time-varying delays is 
investigated. Sufficient conditions are given in terms of 
linear matrix inequalities which can be easily solved by 
LMI Toolbox in Matlab. Numerical examples are given to 
indicate significant improvements over some existing 
results. 
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